Approximate Dynamic Programming: Health Care Applications

This dissertation considers different approximate solutions to Markov decision problems formulated within the dynamic programming framework in two health care applications. Dynamic formulations are appropriate for problems which require optimization over time and a variety of settings for different scenarios and policies. This is similar to the situation in a lot of health care applications for which because of the curses of dimensionality, exact solutions do not always exist. Thus, approximate analysis to find near optimal solutions are motivated. To check the quality of approximation, additional evidence such as boundaries, consistency analysis, or asymptotic behavior evaluation are required. Emergency vehicle management and dose-finding clinical trials are the two heath care applications considered here in order to investigate dynamic formulations, approximate solutions, and solution quality assessments. The dynamic programming formulation for real-time ambulance dispatching and relocation policies, response-adaptive dose-finding clinical trial, and optimal stopping of adaptive clinical trials is presented. Approximate solutions are derived by multiple methods such as basis function regression, one-step look-ahead policy, simulation-based gridding algorithm, and diffusion approximation. Finally, some boundaries to assess the optimality gap and a proof of consistency for approximate solutions are presented to ensure the quality of approximation

Opium use and risk of mortality from digestive diseases: A prospective cohort study

Objectives:Opium use, particularly in low doses, is a common practice among adults in northeastern Iran. We aimed to investigate the association between opium use and subsequent mortality from disorders of the digestive tract.Methods:We used data from the Golestan Cohort Study, a prospective cohort study in northeastern Iran, with detailed, validated data on opium use and several other exposures. A total of 50,045 adults were enrolled during a 4-year period (2004-2008) and followed annually until December 2012, with a follow-up success rate of 99. We used Cox proportional hazard regression models to evaluate the association between opium use and outcomes of interest.Results:In all, 8,487 (17) participants reported opium use, with a mean duration of 12.7 years. During the follow-up period 474 deaths from digestive diseases were reported (387 due to gastrointestinal cancers and 87 due to nonmalignant etiologies). Opium use was associated with an increased risk of death from any digestive disease (adjusted hazard ratio (HR)=1.55, 95 confidence interval (CI)=1.24-1.93). The association was dose dependent, with a HR of 2.21 (1.57-3.31) for the highest quintile of cumulative opium use vs. no use (P trend =0.037). The HRs (95 CI) for the associations between opium use and malignant and nonmalignant causes of digestive mortality were 1.38 (1.07-1.76) and 2.60 (1.57-4.31), respectively. Increased risks were seen both for smoking opium and for ingestion of opium.Conclusions:Long-term opium use, even in low doses, is associated with increased risk of death from both malignant and nonmalignant digestive diseases

The global, regional, and national burden of oesophageal cancer and its attributable risk factors in 195 countries and territories, 1990-2017: A systematic analysis for the global burden of disease study 2017

© 2020 The Author(s). Background Oesophageal cancer is a common and often fatal cancer that has two main histological subtypes: oesophageal squamous cell carcinoma and oesophageal adenocarcinoma. Updated statistics on the incidence and mortality of oesophageal cancer, and on the disability-adjusted life-years (DALYs) caused by the disease, can assist policy makers in allocating resources for prevention, treatment, and care of oesophageal cancer. We report the latest estimates of these statistics for 195 countries and territories between 1990 and 2017, by age, sex, and Socio-demographic Index (SDI), using data from the Global Burden of Diseases, Injuries, and Risk Factors Study 2017 (GBD). Methods We used data from vital registration systems, vital registration-samples, verbal autopsy records, and cancer registries, combined with relevant modelling, to estimate the mortality, incidence, and burden of oesophageal cancer from 1990 to 2017. Mortality-to-incidence ratios (MIRs) were estimated and fed into a Cause of Death Ensemble model (CODEm) including risk factors. MIRs were used for mortality and non-fatal modelling. Estimates of DALYs attributable to the main risk factors of oesophageal cancer available in GBD were also calculated. The proportion of oesophageal squamous cell carcinoma to all oesophageal cancers was extracted by use of publicly available data, and its variation was examined against SDI, the Healthcare Access and Quality (HAQ) Index, and available risk factors in GBD that are specific for oesophageal squamous cell carcinoma (eg, unimproved water source and indoor air pollution) and for oesophageal adenocarcinoma (gastro-oesophageal reflux disease). Findings There were 473 000 (95% uncertainty interval [95% UI] 459 000-485 000) new cases of oesophageal cancer and 436 000 (425 000-448 000) deaths due to oesophageal cancer in 2017. Age-standardised incidence was 5.9 (5.7-6.1) per 100 000 population and age-standardised mortality was 5.5 (5.3-5.6) per 100 000. Oesophageal cancer caused 9.78 million (9.53-10.03) DALYs, with an age-standardised rate of 120 (117-123) per 100 000 population. Between 1990 and 2017, age-standardised incidence decreased by 22.0% (18.6-25.2), mortality decreased by 29.0% (25.8-32.0), and DALYs decreased by 33.4% (30.4-36.1) globally. However, as a result of population growth and ageing, the total number of new cases increased by 52.3% (45.9-58.9), from 310 000 (300 000-322 000) to 473 000 (459 000-485 000); the number of deaths increased by 40.0% (34.1-46.3), from 311 000 (301 000-323 000) to 436 000 (425 000-448 000); and total DALYs increased by 27.4% (22.1-33.1), from 7.68 million (7.42-7.97) to 9.78 million (9.53-10.03). At the national level, China had the highest number of incident cases (235 000 [223 000-246 000]), deaths (213 000 [203 000-223 000]), and DALYs (4.46 million [4.25-4.69]) in 2017. The highest national-level agestandardised incidence rates in 2017 were observed in Malawi (23.0 [19.4-26.5] per 100 000 population) and Mongolia (18.5 [16.4-20.8] per 100 000). In 2017, age-standardised incidence was 2.7 times higher, mortality 2.9 times higher, and DALYs 3.0 times higher in males than in females. In 2017, a substantial proportion of oesophageal cancer DALYs were attributable to known risk factors: tobacco smoking (39.0% [35.5-42.2]), alcohol consumption (33.8% [27.3-39.9]), high BMI (19.5% [6.3-36.0]), a diet low in fruits (19.1% [4.2-34.6]), and use of chewing tobacco (7.5% [5.2-9.6]). Countries with a low SDI and HAQ Index and high levels of indoor air pollution had a higher proportion of oesophageal squamous cell carcinoma to all oesophageal cancer cases than did countries with a high SDI and HAQ Index and with low levels of indoor air pollution. Interpretation Despite reductions in age-standardised incidence and mortality rates, oesophageal cancer remains a major cause of cancer mortality and burden across the world. Oesophageal cancer is a highly fatal disease, requiring increased primary prevention efforts and, possibly, screening in some high-risk areas. Substantial variation exists in age-standardised incidence rates across regions and countries, for reasons that are unclear

Comparing the Lifestyle Interventions for Prediabetes: An Integrated Microsimulation and Population Simulation Model.

We developed a model to compare the impacts of different lifestyle interventions among prediabetes individuals and to identify the optimal age groups for such interventions. A stochastic simulation was developed to replicate the prediabetes and diabetes trends (1997-2010) in the U.S. adult population. We then simulated the population-wide impacts of three lifestyle diabetes prevention programs, i.e., the Diabetes Prevention Program (DPP), DPP-YMCA, and the Healthy Living Partnerships to Prevent Diabetes (HELP-PD), over a course of 10, 15 and 30 years. Our model replicated the temporal trends of diabetes in the U.S. adult population. Compared to no intervention, the diabetes incidence declined 0.3 per 1,000 by DPP, 0.2 by DPP-YMCA, and 0.4 by HELP-PD over the 15-year period. Our simulations identified HELP-PD as the most cost-effective intervention, which achieved the highest 10-year savings of $38 billion for those aged 25-65, assuming all eligible individuals participate in the intervention and considering intervention achievement rates. Our model simulates the diabetes trends in the U.S. population based on individual-level longitudinal data. However, it may be used to identify the optimal intervention for different subgroups in defined populations